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as originally filed/furnished 



pages 1 
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received by this Authority on 
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the claims: 
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as originally filed/furnished 
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as amended (together with any statement) under Article 19 
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Industrial applicability (IA) 



Claims 
Claims 

Claims 
Claims 

Claims 
Claims 
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2. Citations and explanations (Rule 70.7) 

Report? leVant dOCUments cited the International Search 

Dl: US6611289 Bl 
D2: EP0858208 Al 

Dl discloses a digital camera and method where multiple images 
are acquired with at least two image capturing device!, Zith 
otw Par f ely Controlled '"Sing different exposure times 
SSoT Si ? * P arameters > • m order to increase the dynamic 

cS?uriL P T 6v iT ° f - a SSC ° nd ima9S ' *>Y a second^mage 

SaSSS Z ' COmbined with a f^st image, which is 

acquxred by a first xmage capturing device. 

?L o a f lB ° discloses a method and camera where images from at 
ibff tw ° . ima ^? capturing devices are combined in ord^r Jo 
obtain a digital image with improved quality. 

fo? ^ PP H^ ed in 7 ention relates to a method and imaging device 
ta^en bt - f enhanced (compared wit* images 

* Y d ? Vlces having a single image capturing device) by 
combining images acquired by at least two different image 

has dif rer en r?/^ Wher ^ at . leaSt ° ne of the capturing device! 
aoLf™ ? S ht 9atherin 3 capability, e.g. larger/smaller 
aperture size. The captured images are combined by using an 
averaging method for each pixel to be combined 
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Referring to claims 1 and 25: 

According to claim 1 an image with enhanced quality is 
obtained by utilizing images acquired by at least two 
different image capturing devices, where at least one of the 
at least two image capturing devices has a different light 
gathering capability. The at least two different images are 
combined by using an averaging method. 

Dl (see for example column 9, row 41-52 and claim 5) discloses 
that images acquired by two different image capturing devices 
are utilized in order to obtain an enhanced (increased dynamic 
range) image. The dynamic range is increased because one of 
the image capturing devices has a different light gathering 
capability (one is a B/W sensor while the others detect one 
primary color each, see column 9, row 4-27) . 

Also, D2 (see claim 1 and page 5, row 33-41) discloses a 
method and device for combining images acquired with image 
capturing devices having different light gathering 
capabilities (different depth of field) . 

In the letter received at 21-11-2005, the applicant states 
that none of Dl, D2 discloses that an averaging method is used 
in the combining procedure. However, using some kind of 
averaging method when combining images is considered to be a 
standard procedure. Also, using an averaging method on a 
pixel-by-pixel basis is explicitly stated in D2 (see paae 4 
row 55-58) . 



In view of the aforementioned, the 
claim 1 lacks novelty. 



invention according to 



The argumentation regarding claim 1 is also valid for claim 
25. Therefore, the invention according to claim 25 lacks 
novelty. 

Referring to claims 2-24, 26-38: 



The invention according 
because Dl (see claim 5) 
image is utilized. 



to claims 2 and 26 lacks novelty, 
describes that a portion of a second 



The invention according to claims 3 and 33 lacks novelty, 
because Dl (see claim 5) and D2 (see claim 1) clearly state 
that the images are combined in order to obtain an enhanced 
image . 

••»/••• 
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The invention according to claim 5 lacks novelty, because D2 
(see page 5, row 33-41) describes that differences in depth of 
field (focal length and aperture) can be utilized in order to 
obtain an enhanced image. 

The invention according to claims 8 and 28 lacks novelty, 
because said claim only describes the basic and fundamental 
operation of a digital image producing device, namely to 
produce an image proportional to the electric signals received 
from an image sensor. The above is also disclosed in Dl (see 
for example column 1, row 23-32 and figure 3) . 

The invention according to claim 10 lacks novelty, because Dl 
(see figure 3 and 4A) and D2 (see figure lb) illustrate a 
device having four lenses . 

The invention according to claims 13 and 14 lacks novelty, 
because D2 (see for example page 6, row 13-17) describes at 
least three image capturing devices each having one of the 
color filters mentioned in claims 13 and 14. 

The invention according to claim 23 lacks novelty, because Dl 
(see figure 3) and D2 (see figure lb) disclose that each image 
capturing device comprises a lens arrangement. 

The invention according to claims 24 lacks novelty, because Dl 
(see column 9, row 43-46) discloses that the image capturing 
devices can have different exposure times. 

The invention according to claim 3 8 lacks novelty, because Dl 
(see figure 3 and column 3, row 62-67) and D2 (see figure la 
and page 3, row 6-8) disclose that each image capturing device 
produces images with a lens arrangement on its own. 

Referring to claims 4,6,7/9,11,12,15-22,27,29-32,34-37: 

Dependent claims 4,6,7,9,11,12,15-22,27,29-32,34-37 do not 
contain any features which, in combination with the features 
of any claim to which they refer, meet the requirements of the 
PCT in respect of inventive step . Said claims only relate to 
obvious and trivial details, such as using different types of 
sensors, e.g. Bayer and infra-red, and measuring parameters, 

. . . / ... 
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e.g. exposure time and using weighted mean calculations, which 
are well known in the art and therefore obvious for a person 
skilled in the art to incorporate into the inventions 
according to Dl and/or D2 without using any inventive skills. 

Hence, the invention according to claims 1-3,5,8,10,13,14,23- 
26,28,33,3 8 lacks novelty. The invention according to claims 
1-38 is not considered involving an inventive step. The 
invention according to claims 1-38 has industrial 
applicability. 

Novelty (N) claims: 4,6,7,9,11,12,15-22,27,29-31,34-37 YES 
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The following observations on the clarity of the claims, description, and drawings or on the question whether the claims are fully 
supported by the description, are made: 

The term "small" used in claim 4 is vague and unclear and 
leaves the reader in doubt as to the meaning of the technical 
feature to which it refers, thereby rendering the definition 
of the subject-matter of said claim unclear (Article 6 PCT) . 
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Claims (Amended 21.11.2005) 

1. An imaging device comprising at least two image capturing appa- 
ratus, each apparatus being arranged to produce an image comprising pixels, 
the apparatus being configured to utilize at least a portion of the images pro- 

5 duced with different image capturing apparatus with each other to produce an 
image with an enhanced image quality characterized in that at least 
one image capturing apparatus has a different light gathering capability and 
that the image produced by the at least one apparatus is used for enhancing 
the dynamic range of the image produced with the other image capturing appa- 
10 ratus by combining at least a portion of the images using an averaging method 
for each pixel to be combined. 

2. The device of claim 1, characterized by the apparatus be- 
ing configured to analyse the images produced with the image capturing appa- 
ratus and to determine which portions of an image to utilize. 

1 5 3. The device of claim 1, characterized by the apparatus be- 

ing configured to combine at least a portion of the images produced with differ- 
ent image capturing apparatus with each other. 

4. The device of claim 1, characterized in that at least one 
Image capturing apparatus has a small aperture. 
20 5. The device of claim 1, characterized in that at least one 

image capturing apparatus has higher aperture than other apparatus. 

6. The device of claim 1, characterized by the apparatus be- 
ing configured to utilise a weighted mean method for each pixel to be com- 
bined. 

25 7. The device of claim 1, characterized in that at least one 

image capturing apparatus comprises a polarisation filter. 

8. The device of claim 1, characterized in that the image 

capturing apparatus comprise a lens system and a sensor array configured to 

p. 

produce electric signal and that the device comprises a processor operationally 
30 connected to the sensor arrays and configured to produce an image propor- 
tional to the electrical signal received from the sensor arrays. 

9. The device of claim 8, characterized in that the device 
comprises a sensor array divided between at least two image capturing appa- 
ratus. 

35 1 0. The device of claim 1, characterized by the device com- 

prising a lenslet array with at least four lenses. 
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1 1 . The device of claim 8, characterized in that the device 
comprises a sensor array and four image capturing apparatus, each apparatus 
using one lens from the lenslet array and a portion of the sensor array. 

12. The device of claim 9, characterized in that three image 
5 capturing apparatus are configured to produce a colour image; that the fourth 

image capturing apparatus is configured to produce an image; and that the 
device comprises a processor configured to combine at least a portion of the 
images with each other to produce an image with an enhanced image quality. 

13. The device of claim 10, characterized in that the three 
10 image capturing apparatus each comprise an unique colour filter from a group 

of filters red, green or blue. 

14. The device of claim 10, characterized in that each of the 
three image capturing apparatus comprises a unique colour filter from a group 
of filters cyan, magenta or yellow. 

15 15. The device of claim 12, characterized in that the fourth 

image capturing apparatus comprises a Bayer matrix. 

1 6. The device of claim 12, characterized in that the fourth 
image capturing apparatus produces infra-red images. 

17. The device of claim 1, characterized in that at least one 
20 image capturing apparatus is shielded for producing a dark reference. 

18. The device of claim 1, characterized in that at least one 
image capturing apparatus is used for measuring white balance. 

1 9. The device of claim 1, characterized in that at least one 
image capturing apparatus is used for measuring exposure parameters. 

25 20. The device of claim 1, characterized in that the fourth 

image capturing apparatus comprises a polarization filter. 

21 . The device of claim 1, characterized in that the fourth 
image capturing apparatus produces images from which a specific light polari- 
zation direction has been removed. 

30 22. The device of claim 1, characterized in that each image 

capturing apparatus comprises a different aperture and is dedicated to a differ- 
ent spectral band. 

23. The device of claim 1 1 , characterized in that each image 
capturing apparatus comprises a lens arrangement. 
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24. The device of claim 1 , characterized in that at least one 
image capturing apparatus is configured to use a different exposure time com- 
pared to other apparatus. 

25. A method of creating an image file in an imaging device, com- 
5 prising producing images comprising pixels with at least two image capturing 

apparatus, utilising at least a portion of the images produced with different 
image capturing apparatus with each other to produce an image with an en- 
hanced image quality characterized by producing images with image 
capturing apparatus of a different light gathering capability and combining at 
10 least a portion of the images using an averaging method for each pixel to be 
combined. 

26. The method of claim 25, characterized by 

analysing the images produced with the image capturing apparatus 

and 

15 determining which portions of the images to utilize. 

27. The method of claim 25, characterized by the combining 
is made using a weighted mean method for each pixel to be combined. 

28. The method of claim 25, characterized by producing im- 
ages with image capturing apparatus comprising a lens system and a sensor 

20 array configured to produce an electric signal and 

processing the images proportional to the electric signal with a 
processor operationally connected to the sensor arrays. 

29. The method of claim 25, characterized by producing im- 
ages with a sensor array and four image capturing apparatus, each apparatus 

25 using one lens from the lenslet array and a portion of the sensor array. 

30. The method of claim 29, characterized by 
producing a colour image with three image capturing apparatus, 
producing an image with the fourth image capturing apparatus and 
combining at least a portion of the images with each other to pro- 

30 duce an image with an enhanced image quality. 

31 . The method of claim 30, characterized by producing a 
colour image with the fourth capturing apparatus by using a Bayer matrix filter. 

32. The method of claim 30, characterized by producing an 
infra-red image with the fourth capturing apparatus. 
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33. The method of claim 25, characterized by combining at 
least a portion of the images produced with different image capturing appara- 
tus with each other. 

34. The method of claim 25, characterized by using at least 

5 one image capturing apparatus for producing a dark reference. 

35. The method of claim 25, characterized by using at least 
one image capturing apparatus for measuring white balance. 

36. The method of claim 25, characterized by using at least 
one image capturing apparatus for measuring exposure parameters. 

o 37. The method of claim 25, characterized by using at least 

one image capturing apparatus for producing images from which a specific 
light polarization direction has been removed. 

38. The method of claim 25, characterized that each image 
capturing apparatus produces images with a lens arrangement of its own. 
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